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Abstract 

The  Computer  Science  Department  program  library  contains  a 
number  of  ALGOL  W  procedures  and  FORTRAN  subroutines  which  can  be 
used  to  solve  systems  of  linear  equations. 

This  report  describes  the  results  of  tests  to  determine  the 
amount  of  time  and  memory  required  to  solve  systems  of  various 
orders. 
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Introduction 

The  Computer  Science  Department  program  library  contains  a  number 
of  ALGOL  W  procedures  and  FORTRAN  subroutines  which  can  be  used  to  solve 
systems  of  linear  equations.  These  include: 


ALGOL  W 

FORTRAN 

single  prec 

.  double  prec . 

single  prec. 

double  prec. 

DECOMPOSE 

LONGDECOMPOSE 

UNSY1 

UNSY2 

SOLVE 

LONGSOLVE 

DECMP1 

DECMP2 

IMPROVE 

LONGIMPROVE 

S0LVE1 

S0LVE2 

SINGULAR 

LONGSINGULAR 

IE2 

IMPRV; 

IMPHV2 

During  the  winter  und  autumn  of  1970  I  tested  these  programs  to  determine 
the  amount  of  time  and  memory  required  to  solve  systems  of  various  orders. 
This  report  describes  the  results  of  these  tests. 


Preliminaries  j 

J 

» 

The  linear  system  Ax  =  b  used  in  all  the  tests  was  composed  of  a 

i 

matrix  A  of  elements  with  random  values  between  -.5  and  *5  generated 
using  the  programs  RANDOM  in  ALGOL  W  (with  initial  value=l)  and  RANDK 

I 

in  FORTRAN  (with  initial  value=l),  and  a  right- hand- side  vector  b  formed 


i 


by  summing  Ur  columns  of  A.  SI  net-  both  routines  return  random  numbers 
with  values  between  0.0  and  1.0,  ouch  value  was  subtracted  from  0.5  to 
give  random  numbers  In  the  dosLred  range.  A  100  x  100  matrix  was 
genera  ted  row  after  row.  Systems  of  order  less  tiian  100  were  formed 
using  the  principal  minors  of  this  larger  matrix.  (Tho  values  of  u(l,.l) 
and  u(l00,100)  were  .1423882  and  -.I31517Q*  respectively.) 

Execution  times  were  computed  using  the  function  PC LOCK  in  FORTRAN 
programs  compiled  by  IBM's  compiler,  and  the  integer  procedure  TIME  in 
AI/10L  W  programs.  Mo  similar  routine  is  available  to  FORTRAN  programs 
compiled  with  the  WATFIV  compiler. 

Other  factors  considered  besides  language  and  precision  of  data  wore: 

1.  FORTRAN  compilers:  TWo  compilers,  WATFIV  and  IBM's  FORTRAN  IV 
H-level  compiler,  are  available  for  FORTRAN  programs. 

2.  Compiler  options:  IBM's  FORTRAN  compiler  allows  various  levels 
of  code  optimization.  OPfrO  and  0FT>2  were  examined.  In 
addition,  the  WATFIV  compiler  allows  the  option  of  checking 
for  uninitialized  variables,  and  the  ALGOL  W  compiler  the 
option  of  checking  array  subscripts  to  see  whether  they  lie 
within  their  proper  bounds. 

3.  Available  memory:  Jobs  were  run  with  QUICK,  STANDARD,  and 
OVERNIGHT  priorities  to  determine  the  maximum  order  of  system 
which  can  be  solved  in  the  partition  sizes  available  to  the  user. 

ISiese  tests  were  run  using  the  level  13  release  of  IBM' 3  operating 
system  QS/36O,  level  17  of  the  FORTRAN  IV  compiler,  the  21  September,  1969, 
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version  of  the  ALGOL  W  compiler,  and  the  version  1,  level  1,  January, 

J  [)  (0 ,  WATF1V  compiler. 

R  suits 

Time  comparisons  between  different  compilers  for  a  system  of  50  equa¬ 
tions  in  single  and  double  precision  follow,  where 

T3  =  time  to  solve  the  system  initially, 

TI  =  time  to  improve  the  solution 
TT  =  total  time, 

and  times  are  given  in  hundredths  of  a  second. 


SINGLE  PRECISION: 


TS 

TI 

TT 

Total  cost  at  09/ min. 

FORTRAN  H 

OPT  =  2 

63 

18 

81 

0.12 

OPT  =  0 

280 

52 

332 

.50 

ALGOL  W 

without 
sub.  check 

393 

52 

445 

.66 

with  sub. 

cheek 

715 

78 

793 

1.18 

WATFIV* 

1274 

1.91 

DOUBLE  PRECISION: 

TS 

TI 

TT 

Total  cost  at  09/rain 

FORTRAN  H 

OPT  =  2 

82 

172 

254 

.38 

OPT  =  0 

304 

234 

538 

.80 

ALGOL  W 

without 
sub.  check 

400 

322 

722 

1.08 

with  sub. 
check 

720 

432 

1152 

1.72 

WATFIV* 

2206 

3.31 

* 

The  times  given 

for  programs  compiled  with  the 

WATFIV  compiler  are  total 

run  times,  including  the 

time  required 

to  generate  the  system,  print  out  the 

results,  etc.  Comparable  times  for  ALGOL  W  programs  are  668  and  805.  Also, 
it  was  found  that  the  difference  in  run  times  for  programs  in  which  checking 
for  initialized  variables  was  performed  and  those  in  which  it  wasn't,  was 
negligible . 
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If  one  takes  into  account  total  execution  time,  including  compile, 
run,  and  r.yntem  overhead  limes,  then  it  is  advisable  to  use  FORTRAN 
program:;  compiled  with  IBM's  compiler  with  0PT=2  for  a  single  system  of 
ord'-r  YO  and  above  since  the  run  times  are  so  much  shorter  than  those  of 
program;;  compiled  with  the  WATFIV  compiler.  For  a  single  system  of  order 
less  than  70  it  is  advantageous  to  use  the  latter  because  of  shorter 
compile  and  system  overhead  times. 

It  should  be  pointed  out  that  the  increased  time  necessary  to  solve 
a  system  of  equations  in  double  precision  is  due  to  the  use  of  the  sub¬ 
routines  DPPUT  and  IPTOTL  in  FORTRAN  and  the  procedure  IPS  in  ALGOL  W. 
These  routines  are  used  to  form  inner  products  in  double  long  precision 
in  order  to  improve  the  initial  solution.  Note  that  the  times  require i 
to  obtain  an  initial  solution  are  about  the  same  in  both  cases.  In  single 
precision  the  time  necessary  to  improve  the  solution  is  only  about  10?  of 
the  total  time,  while  in  double  precision  tills  percentage  increases 
noticeubly. 

The  times  to  solve  the  system  and  the  total  times  required  for  dif¬ 
ferent  values  of  N,  using  the  FORTRAN  programs  compiled  with  IBM's 
compiler  with  0PT=2,  and  using  the  ALGOL  W  procedures  without  subscript 
checking,  were  fitted  with  a  cubic  polynomial  using  a  least  squares  crite¬ 
rion.  Similarly,  the  times  to  improve  were  fitted  with  a  quadratic  poly¬ 
nomial.  These  various  times  may  then  be  computed  for  different  values  of 
N,  using  the  formula 

3 

time(n)  =  £  a(i)*(n/lO)**i, 

i=0 
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where  the  values  of  the  coefficients  are  given  below.  15,  TI,  and  TT  are 
as  defined  before,  and  times  are  again  given  in  hundredths  of  a  second. 


FORTRAN  Times 


Single  precision  Double  precision 


N 

TS 

TI 

TT 

TS 

TI 

TT 

10 

1 

1 

2 

1 

4 

5 

20 

5 

3 

8 

6 

15 

21 

30 

15 

7 

22 

20 

62 

82 

4o 

34 

12 

46 

43 

109 

152 

‘,0 

63 

18 

81. 

82 

172 

254 

6o 

107 

26 

133 

139 

240 

379 

Y0 

167 

37 

204 

216 

324 

540 

80 

24/ 

46 

293 

317 

431 

748 

00 

3-Y3 

58 

406 

451 

532 

983 

100 

469 

70 

539 

645 

691 

1336 

Coefficients : 

single  precision 

a(0) 

a(l) 

a(2) 

a(3) 

tinv- 

to  solve 

2.10 

-1.96 

O.83 

0.40 

time 

to  improve 

-0.6/ 

0.62 

0.65 

total 

time 

3.23 

-2.94 

I.83 

0.38 

Coeffi' 

:ients: 

double  precision 

time 

to  solve 

-14.00 

14.85 

-3.45 

O.85 

time 

to  Improve 

-  2.00 

-1.00 

6.91 

total 

t  L  me 

-36.33 

31.79 

-0.45 

1.09 

ALGOL  W  Times 


Single 

precision 

Double  precision 

N 

TS 

T1 

TT 

TS 

T1 

TP 

10 

5 

2 

7 

5 

17 

22 

20 

30 

8 

38 

30 

55 

85 

30 

92 

18 

110 

93 

122 

215 

1(0 

207 

33 

240 

210 

207 

417 

50 

393 

52 

445 

400 

322 

722 

6o 

663 

73 

736 

690 

453 

1143 

70 

1046 

97 

1143 

1070 

617 

1687 

80 

1535 

128 

1663 

1580 

792 

2372 

90 

2173 

160 

2333 

2231 

1002 

32  3  3 

100 

2965 

195 

3160 

3045 

1230 

4275 

Coefficients: 

single  precision 

a(0) 

a(l) 

a(2) 

a(  3) 

time 

to  solve 

-1.93 

2.67 

1.11 

2.83 

time 

to  improve 

-2.03 

1.52 

I.83 

total 

time 

-2.17 

2-53 

3.28 

2.81 

Coefficients: 

double  precision 

time 

to  solve 

0-73 

-O.87 

2.00 

2.85 

time 

to  improve 

13.07 

-1.89 

12.16 

total 

time 

0.4: 

3-79 

13.92 

2.84 

The  order  of  the  largest  solvable  system  is  limited  by  the  size  of 
the  partition  in  which  the  program  is  executed,  (in  FORTRAN,  the  maximum 
order  is  fixed  at  100  by  the  routines  but  can  be  increased  by  changing  the 
dimension  of  the  vectors  SCAUSS  in  EECMP1  and  EECMF2,  and  R  and  DX  in 
IMPRV1  and  IMPRV2.) 

■Rie  amount  of  storage  required  by  the  minimum  number  of  arrays  necessary 
to  solve  a  system  of  order  N  is 

(2*N*#2  +  6*N)  *  4  bytes  in  single  precision 

and 

(2*N**2  +  6*N)  *  8  bytes  in  double  precision. 
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Using  this  minimum  storage  requirement,  the  orders  of  the  largest  systems 
which  can  be  solved  using  the  FORTRAN  subroutines  compiled  with  IBM's 
compiler  and  the  ALGOL  W  procedures  are  approximately 

FORTRAN 


single  prec.  double  prec. 

standard  partition  200  140 

overnight  partition  2k$  1JO 


ALGOL  W 


single  prec. 

double  prec. 

quick  partition 

105 

75 

standard  partition 

195 

IkO 

overnight  partition 

250 

175 
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